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We introduce Network Automata, a framework which couples the topological evolution of a net- 
work to its structure. It is useful for dealing with networks in which the topology evolves according 
to some specified microscopic rules and, simultaneously, there is a dynamic process taking place on 
the network that both depends on its structure but is also capable of modifying it. It is a generic 
framework for modeling systems in which network structure, dynamics, and function are interre- 
lated. At the practical level, this framework allows for easy implementation of the microscopic rules 
involved in such systems. To demonstrate the approach, we develop a class of simple biologically 
inspired models of fungal growth. 



PACS numbers: 89.75.Fb, 87.15.A-, 87.85.Xd 
I. INTRODUCTION 

The network framework has proved very successful in 
the study of various complex interacting systems. In 
the network description, the interacting elements are de- 
picted as nodes and the interactions between the elements 
are represented by links connecting the corresponding 
nodes. The science of complex networks has progressed 
very quickly in the last few years, and some excellent re- 
views have been written covering both the methodology 
and key results [1, 2, 3]. The strength of the complex net- 
work paradigm lies in its ability to capture some of the 
essential structural characteristics of interacting systems 
while reducing the details of both the elements and their 
interactions. Consequently, the early complex network 
literature was almost exclusively focused on structural 
properties of networks. 

In many out-of-equilibrium growing networks, the evo- 
lution at a given time is dependent on the configuration of 
the network at that time, as exemplified in the preferen- 
tial attachment model of Barabasi and Albert Q. In this 
paper, we develop the Network Automata (NA) frame- 
work, which can be seen as a natural extension of the 
Cellular Automata (CA) framework [5[. When employed 
to model dynamic, functional networks, the NA frame- 
work not only removes ambiguity at an implementation 
level through exhaustive specification of the microscopic 
ruleset employed, it also provides a platform for compar- 
ison between apparently different network algorithms. 

While structural properties remain important in con- 
straining the behavior of the system, there is also sig- 
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niflcant interest in understanding dynamical processes 
taking place on networks [6(]. Indeed, the marriage be- 
tween structure and dynamic processes is so strong that 
the behavior of dynamic processes can be used to detect 
structure Q. While a network's topology constrains the 
type of dynamics that may unfold on it, in many scenar- 
ios the dynamical process may influence the subsequent 
evolution of the topology - meaning that the structural 
properties of the network are coupled to its function. A 
real-world example might be the evolution of transport 
links within a city. The dynamics of the human popula- 
tion using this network in turn affect the reinforcement 
or removal of the those transport links and the feedback 
process is apparent. A similar situation may arise in 
the context of social networks, where one's current social 
opportunities and dynamics are limited by the existing 
network structure, but they can be widened by extending 
the network. 

There have been several specific attempts in the lit- 
erature to inter-relate a network's structure, dynamics, 
and function [H, 0, [TO, EU- However, the present paper 
distinguishes itself by providing a generic framework for 
dealing with these types of systems. While many network 
generating algorithms and Cellular Automata models 
can be easily reproduced within the Network Automata 
framework [12[, its usefulness is exemplified when it is 
applied to systems in which topological evolution is cou- 
pled to a dynamic process occurring upon the network. 
Its contribution to the network field lies in the fact that 
it enables a precise specification of the microscopic rules 
underlying the structural and functional evolution of a 
given network-based system, thereby enabling compari- 
son between different classes of network. We describe the 
framework in Sect ion [TT] and as a demonstration, we intro- 
duce a class of progressively more realistic, biologically- 
inspired models of woodland fungal growth in Section [Till 
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Although the models consist of simple rulesets, they are 
nevertheless capable of producing structures qualitatively 
similar to mycelial network development (e.g. Fig. [I]). 
This example is Phanerochaete velutina, a foraging sapro- 
trophic woodland fungus that builds an adaptive network 
to translocate resource [l3|, EH EH • The transport flux is 
oscillatory and still not fully understood [H], EH, EH E3] • 




FIG. 1: (Color online) Transport of non- metabolised, ra- 
dioactively labelled amino acid within Phanerochaete ve- 
lutina, a foraging woodland fungi. The image was taken using 
photon counting scintillation imaging [l4L flHj ] . 



II. NETWORK AUTOMATA 

Consider an arbitrary weighted or unweighted, di- 
rected or undirected network at some time t which is 
to be grown to some size N tot . As nodes might be added 
to the system at each time step, the network would con- 
ventionally be considered to be growing. An alternative 
representation is to treat the system as being of size N tot 
at all times where at some time t many of the nodes have 
no links. Information regarding the network's topology is 
entirely encompassed within the adjacency matrix A(t) 
which is of dimension Ntot x Ntot- The matrix holds infor- 
mation about which links exist, their direction and, per- 
haps, weights. One might consider the evolution of the 
network as a process that alters the elements within this 
adjacency matrix, updating the attributes of any of the 
possible links which could exist in the system. We base a 
framework of network growth around this concept. If the 
microscopic ruleset governing the network's evolution is 
solely related to quantities which can be derived from the 
network's current topology (and hence from A(t)) then 
the evolution of the network might be expressed in terms 
of some operation F acting upon the adjacency matrix: 

A(t+1) = F(A(t)). (1) 



The ruleset employed could relate to any property of the 
nodes (their degree, betweenness, clustering and so on) 
or the links (weights or direction) and might be deter- 
ministic or stochastic. 

This concept can be achieved in practice by visiting 
all possible links within the adjacency matrix A(t) for a 
network comprising Ntot nodes (whether part of a com- 
ponent or not) once every time step. The update as to 
the nature of the link at the next time step (its exis- 
tence or its weight or direction) is then prescribed by the 
ruleset [2l|. The ruleset can take the form of a lookup 
table in which the state of a link is evaluated and the 
color (existence/direction/weight) is prescribed for the 
next timestep. This update process is analogous to the 
update of a cell within a conventional Cellular Automa- 
ton [18[ except that it acts upon the connectivity (or 
neighbourhood) of an node, thereby generating A(t+ 1). 
This link-orientated update is a generic description of a 
dynamic network and all the essential features of that 
network's evolution are then contained within the ex- 
haustive ruleset. We describe such a system as a Network 
Automaton [22[. No restriction has yet been made as to 
the directionality or weight of links. 

Now consider a situation in which the topology of a 
network evolves while there is simultaneously some pro- 
cess taking place on the network. At any given time the 
topology of the network constrains the type of dynam- 
ics that may unfold on it. However, the dynamical pro- 
cess may influence the subdequent topological evolution 
of the network, so that its structural properties are cou- 
pled to its function and vice versa. The ruleset governing 
the topological update process relates not only to net- 
work related quantities but also functional aspects of the 
nodes and/or links. Since the functional process requires 
a network on which to perform, we decouple the evolu- 
tion of the network into two distinct phases, namely, that 
affecting its topology and that governing the functional 
process. Writing the functional information (relating to 
nodes and/or links) at some time t as some matrix S(t), 
the formal description of the evolution can be expressed 
in terms of some operations F and G as 

A(t + 1) = F(A(*),S(*)), (2) 

S(t + 1) = G(A(t+l),S(t)). (3) 

This expression states that the network evolves accord- 
ing to some process, which is determined by its own cur- 
rent topology A(t), and also by some attributes of its 
nodes and links that includes function-based information 
S(t) [23[. The functional process then occurs on this net- 
work to generate the new set of information S(t+ 1). The 
global state of the system is encompassed by the matrices 
A and S. 

III. BIOLOGICALLY INSPIRED MODEL 

We now construct a series of simple models of wood- 
land fungi [H, El, EE, El] to demonstrate the versatil- 
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ity of the Network Automata framework. Although the 
model, which describes the growth of the fungi and dis- 
tribution of resources within it, is biologically inspired, 
its aim is not to incorporate a large number biological 
details. Instead, we adopt a minimalist approach to em- 
ulate fungal growth and internal nutrient transport from 
a small set of microscopic rules. We start by specify- 
ing biologically naive and mathematically simple update 
rules (Ruleset a) which govern the topological part of 
the system evolution as in Eq. O This is paired to a 
simple functional update process (Process 1) represent- 
ing Eq. OH The two combined fully define the model. We 
then modify both the topological rules (Ruleset b and 
c) and functional process (Process 2) according to some 
basic physical and biological considerations providing 6 
distinct models. The end product may serve as a plat- 
form for more elaborate future models of fungal growth, 
demonstrating the effectiveness of using the framework. 




FIG. 2: (Color online) A biologically inspired multi-agent 
model whereby the agent layer is superimposed upon a re- 
source layer. Agents above a resource can accumulate re- 
sources at some rate Re- 

Consider a system of agents who might each be inter- 
preted as a cell in a two dimensional lattice. The con- 
nectivity between agents is North, South, East and West 
reflecting a possible connectivity of 4, so that agents are 
restricted to local information as long range communica- 
tion is assumed unlikely in the biological system. The 
agent layer is superimposed on a resource layer as in 
Fig. [2j The rules of the system are very simple. If an 
agent is above a resource, it absorbs that resource at 
some rate Re- The objective of each agent is two- fold: to 
grow into available space in the search for more resource, 
and to redistribute excess internal resource to support 
further exploration. We allow each agent to grow only 
one new neighbor (in a random direction) at a particular 
time, but only if the agent has resources to do so. To 
mimic active transport of resources to the growing tip, 
an agent passes resources to its neighbor cell provided 



that the neighbor does not pass resources to it. We now 
endeavor to categorize this simple multi-agent system in 
the NA framework. This serves not only to clarify any 
ambiguities that arise in the programming of a multi- 
agent system, but also as a potential aid to improving 
efficiency in that the required iteration and information 
storage/retrieval aspects are clearly defined by the rule- 
sets imposed. 

Let us first look at the growth (topological) stage. 
Each cell or agent represents a node and the boundary 
between two cells through which resource is passed is rep- 
resented by a link. Consider that the information upon 
which the topological ruleset will act to update the at- 
tributes of a link in the network is simply the amount 
of resource that each of the two nodes has at each end 
of the link and their in and out-degrees. We can sim- 
ply write the functional information as a vector such 
that Si(t) refers to the resource (functional variable) that 
agent (node) i has at time t. For clarity, we can ex- 
press some topological information as vectors too, such 
that the element ki(t) represents the total degree of a 
node, outki(t) its out-degree which, in turn, provides its 
in-degree mfe(t), each of which is obtainable from the 
adjacency matrix A(t). 

We will grow this Network Automaton in an un- 
weighted but directed adjacency matrix A so that if 
Aij = 1 the link exists and is directed from i to j, 
whereas if Ajj = 1 the link exists and is directed from j 
to i. If neither Aij = 1 nor Aj^ = 1 then the link does 
not exist. Here Aij and Aj^ are mutually exclusive. As 
each node has limited possible connectivity (here 4), we 
only consider the subset of links in the system which 
could possibly exist. The structural update process runs 
through all of these possible links and each pair of nodes 
which could be connected is considered once. The link 
attributes A iy j and Aj yi are then updated at the same 
time. 

We can now write the network update procedure for 
this topological update as Ruleset a in terms of an ex- 
haustive truth table as in Table H Note that if Aij(t) = 
Aj t i(t) = 0, the total degree of both nodes i and j is 
less than the connectivity d of the lattice in which the 
system evolves. We denote the outcome of a Bernoulli 
trial as oo(p) such that P(co(p) = 1) = p and conversely 
P(co(p) = 0) = 1 — p. We employ a step function <j)(x) 
defined as (j)(x) = 1 for x > and <p(x) = for x < 0. 

We now describe the resource distribution (functional) 
stage and start by mapping the adjacency matrix A(t+1) 
to a normalised transition matrix T(t + 1) describing the 
flow of resource between adjacent cells: 

T / un _ / Ai,i(* + l)/outfc»(*+l) for O utfei(t+l)>0 
hj[ + ' ~ \0 for O utfci(t+l) = 

m _ JO for out ki(t + 1) > , v 

+ " \ 1 for out fe i (t+l) = 0. W 

Through this process, an agent distributes resource 
equally amongst those neighbours which are not trans- 
mitting resource to it. 
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TABLE I: Different rulesets (the columns labeled 'time £+ 1') for three biologically inspired models: (a) the simplest scenario, 
(b) incorporating conservation of resources, and (c) implementing a delay factor (see text for details). As Aij and Aj,i are 
mutually exclusive, there are only 12 possible states of a link at time t. 



We can then write the update for the resource distri- 
bution process as 



S{t+1) = Tt(£ + l)S(£) +£(£), 



(5) 



where the vector £ corresponds to the accumulation of 
resource by agents from the resource (substrate) layer. 
We impose the constraint that only "alive" (i.e. active) 
agents can accumulate resource through this process so 



(6) 



where the vector L denotes the (binary) existence of re- 
source at position of node (agent) i in the resource layer, 
Re is the rate at which an agent accumulates the re- 
source and <j>(x) is the step function defined earlier. This 
resource accumulation from the substrate could be made 
time dependent (i.e. finite resources) although here we 
will not consider this effect. Equations [H [5] and [6] 
constitute Process 1 and represent the functional update 
stage of Eq. 03 

For the example of Fig.[3l the amount of resources that 
node i has at time t + 1 is 



Si(t + 1) = Sj(t) 
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(7) 



We can now observe the Network Automaton in oper- 
ation as shown in Fig. [U We start with a single node 
r] above a single food source so that at time t = the 
agent has some resource. In the initial configuration the 
adjacency matrix is all zeros Aij(0) = Vz, j, and the re- 
source information vector is all zeros except 5^(0) = Re 
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FIG. 3: The influx of resource into node labelled i. The 
amount this node receives from node j is related to the 
out-degree of node j. This amount would be expressed as 

Sj(t)/outkj(t+l). 



such that the initial agent has amount Re- For this ex- 
ample, the resource accumulation vector £(£) is also all 
zeros except £n(t) = -R^Vt. We observe both the net- 
work and functional aspect of the system. The nodes 
(agents) are superimposed on the directed network, and 
the amount of resources a node has, is indicated by its 
color ranging from blue (low concentration) to dark red 
(high concentration) [l2|, [l6[ . Only nodes that have re- 
sources are included and the result is independent of the 
choice of Re- A longer simulation is shown in Fig. [5j 

Note that under this ruleset and functional update 
stage an agent might accumulate resource indefinitely. 
By allowing a node which has in-degree equal to the max- 
imum connectivity (- m ki = d) to randomly flip a direction 
of one of its links overcomes this biologically unfeasible 
behavior and results in the topological update of (Rule- 
set b) where the Kronecker delta function is defined as 
5{x, y) = for x ^ y and 5(x, y) = 1 for x = y. A simula- 
tion of this ruleset coupled with the functional update of 
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Process 1 is shown in Fig. El and emergent canalized flux 
channels are clear. Such channels have been observed ex- 
perimentally in a wide class of real biological fungi [l5l ]. 

t=0 t = 2 




FIG. 4: (Color online) The evolution of the biologically in- 
spired NA over 6 timesteps. The colors represent the amount 
of resource Si(t) a node has (the functional aspect) superim- 
posed on a directed network (the structural aspect). 



In Rulesets a and b, the physical transport of nutri- 
ent is of comparable speed to that of the growth, which 
is clearly not reasonable for most biological systems. A 
further development can be made to incorporate two dif- 
ferent time scales in the model so that the growth and 
redistribution of resources take place at different rates, 
leading to Ruleset c. To establish this feature within in 
the model, we can delay the growth process by introduc- 
ing a parameter g to the stochastic growth terms in the 
ruleset, so that an agent grows on average one neigh- 
bor every 1/g time steps. This is depicted explicitly in 
Table H The result of such a delay is the build up of re- 
source towards the periphery of the object as one might 
expect [l5|. This is illustrated in Fig. [1] for the real fungi 
and in Fig. El for the model. 

We can also incorporate consumption of resources by 
agents in the model by making further modifications to 
the functional update stage, resulting in Process 2. If an 
agent has more than some residual consumption amount, 
Rc, then this rate of consumption is deducted. If the 
agent has less than this value, all of that agent's resources 
are removed and that agent might be considered dead. 
The initial stage in the functional update process can be 
described in a similar manner to Eq. El 

S'(t + 1) = T\t+l)S(t)+i(t), (8) 

where the resource distribution is described by the transi- 
tion matrix T(t+1) defined in Eq.[2]and the accumulation 
of resource from the substrate is described by the vector 
£ (t) defined in Eq. [6j We can then write the update for 



S_(t + 1), including consumption of resource as 

Si(t + 1) = ttSlit + V-RcMit + y-Rc), 

(9) 

which makes use of the step function <j)(x). Only agents 
(nodes) active in the network can accumulate resources 
from the resource layer. The effect of this "cost" of living 
clearly limits the potential size of the system. Equations 
HI El El and [9] constitute Process 2 and the effect of 
using this functional update are illustrated in Fig. El 

IV. CONCLUDING REMARKS AND 
DISCUSSION 

In this paper we have developed the concepts of Net- 
work Automata (NA) which can couple evolution and 
function of complex networks by using simple microscopic 
rules at the level of nodes and links. We have demon- 
strated the practicability of the framework by applying 
it to a class of biologically inspired models, which pro- 
duce qualitatively similar canalised flow patterns to those 
observed in real woodland fungi pjl EE 03, EH- This 
suggests that for organisms that have to adapt their mor- 
phology to a variable environment, function may play a 
crucial role in determining structure. The well defined 
and simple rulesets not only make replication straight- 
forward but also aid implementation at the programming 
level. In the study of emergent phenomena involving 
networks, this framework enables concise and clear es- 
tablishment of microscopic rules. One can easily think of 
more complex rulesets to more accurately model a real 
system, such as adding transport costs or finite resources, 
both of which can easily be accomplished, or even a time- 
dependent ruleset. It is then interesting to ask what level 
of complexity is required to more accurately model real 
biological systems. 

We expect there to be many application domains for 
Network Automata from social to biological systems. 
One can envisage applying the NA framework also to dis- 
crete differential equation modeling and Diffusion Lim- 
ited Aggregation (DLA) systems and, indeed, to any 
system in which the dynamics of network topology is 
related to the function performed thereon. There are 
certain biological systems which can quasi-solve increas- 
ingly complex problems in a constant time. An example 
is Physarum polycephalum, the true slime mold, which 
approximately identifies the Steiner points when placed 
upon multiple food sources [20[ . Given that it might be 
possible to model these systems within the NA frame- 
work, it might suggest how to design a hardware based 
implementation to perform similar calculations in con- 
stant time. It is interesting to pose the question as to 
what kind of problems could be solved by such a system 
and how complex the microscopic rules would be for a 
given problem. This would reflect the minimum length 
of ruleset that would have to be employed by the system 
in both the network and functional update stages. 
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FIG. 5: (Color online) Simulated output for the Rulesets a, b and c and functional updates of Processes 1 and 2. For all 
models, the lattice is of dimension 400 x 400 with periodic boundary conditions. Each was seeded with a single initial agent 
above a single (infinite) resource. The rate of resource accumulation for that agent is Re = 80, 000 and the simulation was run 
for 2000 time steps for each model. For Process 2 the residual consumption rate of each agent is set at Rc — 1. For Ruleset c, 
the delay factor is g = 0.1. 
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